Papers with natural language understanding task
Seeing Things from a Different Angle:Discovering Diverse Perspectives about Claims (N19-1)
Copied to clipboard
| Challenge: | a number of fact checking techniques are used to identify and eliminate biases in text data. |
| Approach: | They propose to use search engines to expand and diversify a dataset of claims, perspectives and evidence to address a selection bias. |
| Outcome: | The proposed approach outperforms existing methods in a language understanding task. |
Know What You Don’t Know: Unanswerable Questions for SQuAD (P18-2)
Copied to clipboard
| Challenge: | Existing datasets focus on answerable questions or use automatically generated unanswerable questions that are easy to identify. |
| Approach: | They propose a dataset that combines the Stanford Question Answering Dataset with 50,000 unanswerable questions written by crowdworkers to look similar to answerable ones. |
| Outcome: | The proposed dataset looks similar to answerable questions on crowd-written questions . strong neural system that gets 86% F1 on SQuAD achieves only 66% F1. |
Zero-shot Cross-lingual Dialogue Systems with Transferable Latent Variables (D19-1)
Copied to clipboard
| Challenge: | a lack of research on multilingual or cross-lingual task-oriented dialog systems has limited results . we propose a zero-shot adaptation of task-orientated dialog systems to low-resource languages . task-focused systems are often trained with monolingual datasets that are expensive to build or acquire . |
| Approach: | They propose a zero-shot adaptation of multilingual task-oriented dialog systems to low-resource languages using latent variables and a set of very few parallel word pairs. |
| Outcome: | The proposed model performs better in natural language understanding task compared to state-of-the-art model . the proposed model uses very few parallel word pairs to refine cross-lingual representations . |
Down and Across: Introducing Crossword-Solving as a New NLP Benchmark (2022.acl-long)
Copied to clipboard
| Challenge: | Recent advances in NLP have led to a growing demand for challenging tasks. |
| Approach: | They propose to solve crossword puzzles as a natural language understanding task . they release a corpus of crossword clues from the daily crossword spanning 25 years . |
| Outcome: | The proposed task is based on a corpus of crossword puzzles from the new york times daily crossword spanning 25 years . the dataset contains over half a million unique clue-answer pairs . |
Event Linking: Grounding Event Mentions to Wikipedia (2023.eacl-main)
Copied to clipboard
| Challenge: | a new task for natural language understanding is called Event Linking . the context where an event is mentioned lacks the details of this event . |
| Approach: | They propose a new task to link an article's event mention to the most appropriate Wikipedia page . they collect a training set from Wikipedia and evaluate two models to test the task . |
| Outcome: | The proposed model is based on a dataset and a real-world news domain . it is expected that the most appropriate Wikipedia page will provide rich knowledge about the mention . |
Joint Reasoning for Temporal and Causal Relations (P18-1)
Copied to clipboard
| Challenge: | a cause must occur earlier than its effect, temporal and causal relations are closely related . a joint inference framework is developed for studying temporal, causal relations . |
| Approach: | They propose a joint inference framework for temporal and causal relations . they use constraints inherent in time and causality to enforce constraints . |
| Outcome: | The proposed framework improves extraction of temporal and causal relations from text. |
Continual Dialogue State Tracking via Example-Guided Question Answering (2023.emnlp-main)
Copied to clipboard
Hyundong Cho, Andrea Madotto, Zhaojiang Lin, Khyathi Chandu, Satwik Kottur, Jing Xu, Jonathan May, Chinnadhurai Sankar
| Challenge: | Dialogue systems are frequently updated to accommodate new services, but naively updating them by continually training with data for new services causes catastrophic forgetting. |
| Approach: | They propose to reformulate dialogue state tracking (DST) as a bundle of example-guided question answering tasks to minimize the task shift between services. |
| Outcome: | The proposed model achieves state-of-the-art performance on DST continual learning metrics without relying on any complex regularization or parameter expansion methods. |
Enhancing Reasoning Capabilities by Instruction Learning and Chain-of-Thoughts for Implicit Discourse Relation Recognition (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for implicit discourse relation recognition are based on generative models, but some studies suggest they do not perform as well as generic encoder-only models for NLU tasks. |
| Approach: | They propose a classification method that is solely based on generative models and utilize Chain-of-Thoughts to partition the inference process into a sequence of three successive stages. |
| Outcome: | The proposed model outperforms existing models on a natural language understanding task. |
Continuous Entailment Patterns for Lexical Inference in Context (2021.emnlp-main)
Copied to clipboard
| Challenge: | Pretrained language models can be used to perform lexical inference in context tasks with relatively small training data. |
| Approach: | They propose to combine a pretrained language model with textual patterns to improve performance in both zero-shot and few-shot settings. |
| Outcome: | The proposed method compares pre-trained models with textual patterns on two established benchmarks for lexical inference in context (LIiC) the results show that the proposed patterns improve performance on LIiC, setting a new state of the art. |
An Improved Neural Baseline for Temporal Relation Extraction (D19-1)
Copied to clipboard
| Challenge: | Existing datasets are small and/or have low inter-annotator agreements. |
| Approach: | They propose a new neural system that achieves 10% absolute accuracy improvement over the previous best system. |
| Outcome: | The proposed system achieves 10% absolute improvement over the previous best system on two benchmark datasets. |